Abstract
Machine Learning (ML) using Artificial Neural Networks (ANNs), referred to as Deep Learning (DL), is a very popular and powerful method of statistical inference. A primary advantage of deep-learning has been the automatic learning of informative features (that encodes the data referred to as deep-representations henceforth) based on gradient-descent optimization of an objective function. While DL is applicable to problem domains where hand-crafted features are not readily available, its performance is critically dependent on other factors like dataset size and model architecture. Despite recent advances in the field, the question of how to modify the DL framework to incorporate domain knowledge or to disentangle factors of variation warrants more research. Until recently, most popular works in the DL literature have primarily employed inductive-bias of architectures (e.g., translational invariance in convolutional neural-nets) and relied on the availability of large labeled datasets for improved representation learning. Unfortunately, curating such large datasets is costly and not practical for many application areas. In this dissertation, we study methods to improve learned representations by incorporating domain knowledge into the learning process and through disentangling factors of variation. First, we present a sparse-modeling based data augmentation method for tomographic images and use it to incorporate domain knowledge of Synthetic Aperture ii Radar (SAR) target phenomenology into deep representations. We validate the improvements in learned representations by using them for a benchmark classification problem of Automatic Target Recognition (ATR) where we establish new state-of-theart on subsampled datasets. Second, we propose a DL-based hierarchical modeling strategy for a physiological signal generation process which in turn can be used for data augmentation. Based on the physiology of cardiovascular system function, we propose a modularized hierarchical generative model and then impose explicit regularizing constraints on each module using multi-objective loss functions. This generative model, called CardioGen, is evaluated by its ability to augment real data while training DL based models. The proposed approach showed performance improvements. Third, we propose a hierarchical deep-generative model for SAR imagery that jointly captures the underlying structure of multiple resolutions of SAR images. We utilize this model, called MrSARP, to super-resolve lower resolution magnitude images to a higher resolution. We evaluate the model’s performance using the three standard error metrics used for evaluating super-resolution performance on simulated data. Fourth, we propose a framework for learning a sufficient statistic of the data for a given downstream inference task. We design and train a DL model that encodes the Photoplethysmography (PPG) signal to a sufficient statistic and decodes it back to a task-specific PPG-like signal assuming it will be used for a fixed RR-tachogram prediction task. Compression and privacy-preservation can be a useful side-benefit of having such a downstream task. The learned deep representations of PPG data are validated using tachogram prediction error as well as its performance on the sub-task of stress estimation. i
Background Of The Study
The importance of quality education at academic institutions cannot be overstat...
ABSTRACT:- This study was carried out to examine the internal conflicts in Nigerian universities; sources, effect...
ABSTRACT
The research topic of this study is the impact of change management in Nigerian Banking Industry, A study of United Bank for Afr...
Abstract
The purpose of the study is to find out the effect of home background on the student’s academic per...
ABSTRACT
Considering the geographic distribution is one of the key features of modern tourism. The web-based GIS is a po...
ABSTRACT
The issue of gender inequality is one which has been publicly reverberating through society for decades. Th...
Abstract
Over the past 10 years, there has been a dramatic increase in the costs of building materials...
Background of the study
Radio, according to Kombo (2015), is a crucial driver for social transformatio...
ABSTRACT
Ficus sycomorous (Family Moraceae) is a plant used in African traditional medicine to treat mental illness, dysentery, cough, di...
Background of the study
The terrorist attacks that took place in New York City, Pennsylvania, and Washi...